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ABSTRACT 

This  paper  is  concerned  with  a  control  system  that  uses  stochastic 
sequences  as  the  means  to  reach  the  steady-state  point.   The  main  part  of 
the  system  is  a  temperature  transducer  which  outputs  a  stochastic  sequence. 
The  time  average  of  the  stochastic  sequence  is  dependent  upon  the  temperature, 
This  sequence  is  then  used  to  control  a  heater. 

A  description  of  this  system  is  included  in  this  paper  as  well  as  the 
appropriate  theory  and  results.   A  system  was  also  constructed. 
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1.   INTRODUCTION 

This  project  proposed  by  Professor  W.  J.  Poppelbaum  is  concerned  with 
a  control  system  in  which  the  control  signals  are  stochastic  sequences.  A 
stochastic  sequence  is  a  random  sequence  of  O's  and  l's.  The  control  system 
that  is  described  is  one  which  controls  temperature.   The  system  consists  of 
three  parts:  the  temperature  transducer,  the  temperature  controller  and  the 

heating  element.   The  temperature  transducer  that  is  used  is  described  in  an 

2 
earlier  paper.   Its  output  is  a  stochastic  sequence  in  which  the  time  aver- 
age is  dependent  upon  the  temperature.  The  temperature  controller  determines 
whether  the  measured  temperature  is  higher  or  lower  than  the  desired  tempera- 
ture and  turns  on  or  off  the  heating  element. 


2.   GENERAL  DESCRIPTION 

Figure  1  shows  the  block  diagram  of  the  temperature  control  system.  The 

temperature  transducer  consists  of  a  reverse-biased  collector-to-base  junc- 

2 
tion.   When  the  voltage  across  this  junction  exceeds  the  breakdown  voltage, 

shot  noise  whose  variance  depends  upon  the  junction  temperature  occurs.   This 

noise  and  a  constant  voltage  are  the  inputs  to  a  comparator.   The  constant 

voltage  is  called  the  temperature  reference  in  Figure  1.   The  output  of  the 

comparator  is  obviously  a  stochastic  sequence.   The  purpose  of  the  temperature 

controller  is  to  determine  the  mean  (or  the  time  average)  of  the  resulting 

stochastic  sequence.   Depending  upon  whether  this  mean  is  above  or  below  some 

predetermined  value,  the  controller  will  turn  on  or  off  the  heating  element. 

There  are  a  number  of  methods  that  may  be  used  to  determine  the  mean  of  the 

stochastic  sequence;  however,  the  one  chosen  is  a  shift  register  shown  in 

Figure  2.   The  shift  register  shifts  every  T  seconds  -  it  shifts  left  if 

Y(kT)  =  0  and  shifts  right  if  Y(kT)  =  1.   Notice  that  the  l»s  and  O's  are 

sorted;  i.e.,  the  l's  are  on  the  left  and  the  O's  are  on  the  right.   Now 

th 
if  the  i   bit  is  observed,  there  is  a  relationship  between  the  probability 

that  the  i   bit  is  equal  to  1  and  the  mean  of  the  stochastic  sequence,  Y(t). 

This  will  be  shown  in  the  next  section.   There  are  two  comments  about  the 

temperature  controller:   l)   the  circuitry  in  implementing  it  should  be  kept 

simple  and  2)  the  controller  acts  as  an  integrator. 
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3 .   THEORY 

Figure  3  shows  the  actual  impementation  of  the  temperature  control  sys- 
tem.  From  this  diagram  calculations  will  he  made.  The  characteristics  of 
X(t)  and  Y(t)  are  discussed  in  reference  2. 

The  calculation  of  the  mean  of  Z(t)  is  necessary.   The  D-type  Flip-Flop 
acts  as  a  sampler  -  it  samples  Y(t)  every  l6.7  ms.  Thus,  each  sample  of  Y(t) 
is  independent.   The  position  of  the  leading  1  in  the  shift  register  may  be 
modelled  by  using  a  Markov  chain,  ^et  tt.  =  the  probability  of  bit  i  having 
the  leading  1,  p  =  the  probability  of  Y(t)  =  1  and  q  =  1  -  p.   Then, 

^     =     q    TT        +     q    1T2 

*i  =  P  Vl  +   g  Vl  for   i=2,    3,    ...,   N-l 


"n 

=   P  Vl  +  P  *N 

Solving, 

TT  . 

1 

i-1 

But,    also 

N 

1 

i=l 

TT.     =    1 

1 

So  that 

1-  E.  1  -  *  i-1 

tt     =  9_     and  ir.    =  V  ^  for  i  =  1,2  , . . .  ,N 

1         !_(£)»  *         !.(£■)»       * 

V  q. 

From  this,  it  is  straightforward  to  calculate  the  probability,  P,  that  the 
L   bit  of  the  shift  register  is  equal  to  1  (or  that  Z(t)=l). 

N   1-(E)     „  i-1   - 

p=   I  — Sr  & 

i=L  l-(^-)N    * 

q. 
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Obviously,  P  =  E  {  Z(t)}. 

At  this  point  the  characteristics  of  the  transducer  and  temperature 
controller  are  known.   It  is  now  necessary  to  model  the  characteristics 
of  the  heating  element.   It  is  assumed  that  the  temperature  to  be  controlled 
is  exponential:   i.e., 

T(t)  =  Tu  -  AT  e"pt  when  Z(t)  =  1 
H 

and    T(t)  =  T  +  AT  e"pt  when  Z(t)  =  0 

where  T(t)  =  controlled  temperature 

T^,Tt   =  maximum,  minimum  tempera- 
ture that  the  heating  element  can 
produce 
AT  =  differential  temperature  and 

AT  <  T„-T_ . 
—  rl   L 

Using  this  model,  it  may  be  shown  that  the  expected  temperature,  E{T}, 
of  the  controlled  environment  will  be: 

E{T}  =  TT  +  P(T„  -  TT  )   where  P  =  E{Z(t)} 
Several  comments  can  now  be  made: 

l).   The  exponential  model  of  the  controlled  temperature  is  a  very 

good  approximation  and  experiments  verify  this. 
2).  The  expected  value  of  the  controlled  temperature  has  a  linear 

relationship  with  the  expected  value  of  Z(t). 
3).   Calculations  are  very  involved  and  complicated  and  consequently, 

not  shown. 
All  the  necessary  information  has  been  presented  to  show  the  steady- 
state  temperature  of  the  control  system.  One  of  the  necessary  results  is 
that  this  temperature  is  dependent  upon  the  setting  of  the  reference 
temperature,  A.   First,  from  the  previous  calculations  it  is  possible  to 
graphically  show  the  steady-state  temperature  of  the  control  system. 


Figure  k   shows  the  necessary  graphs:   there  is  the  response  curve  of 
the  transducer  (two  curves  are  shown  but  one  is  for  a  positive  reference, 
A,  and  the  other  is  for  a  negative  reference,  A)  and  there  is  the  curve 
for  the  response  of  the  temperature  controller.   The  latter  curve  is 

plotted  with  two  assumptions:   l).   N  is  an  even  integer  and  2). 

N 
L  +  1  -  2  •  Using  these  assumptions, 

Cp_)N/2 
P  =  SL 


1  +  (*)N/2 


N/2 


or  E{T}  =  TT  +  3- , —   (T  -  T  ) 

L    !  +  (E.)N/2     UH   V 

The  equation  shown  in  Figure  k   is  the  inverse  of  the  above  equation.   It  is 
observed  that  there  are  two  intersections  of  the  response  curve(s)  and 
the  temperature  controller  curve.   (Actually,  there  is  only  one  intersection 
depending  upon  whether  A  is  positive  or  negative).   Steady-state  point  1 
is  such  that  if  there  is  a  perturbation  of  the  temperature,  the  steady-state 
value  of  the  temperature  will  be  approached  monotonically  as  shown  in 
Figure  5.   Steady-state  point  2  is  such  that  if  there  is  a  perturbation  of 
the  temperature,  the  steady-state  value  of  the  temperature  will  be  approached 
alternately  as  shown  in  Figure  6.   With  the  change  of  A,  the  response  curve 
of  the  transducer  shifts  to  the  right  or  the  left.   The  shape  of  the  curve 
reamins  intact.   Therefore,  the  change  of  the  temperature  reference,  A,  does 
have  an  effect  on  the  steady-state  temperature.   Note  that  the  shifting  of 
the  transducer  response  curve  to  the  left  can  make  the  control  system  unstable, 
The  slopes  of  the  two  curves  are  such  that  a  perturbation  will  make  the 
system  diverge  from  the  steady-state  point  (unstablility)  .   Thus,  there  is 
a  range  of  values  that  the  temperature  reference  may  take  so  that  the  system 
reamins  stable. 
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Figure  k.      Graph  of  the  Steady-State  Temperature  of  the  Control  System 
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Figure  5.     Approach  to  the  Steady-State  Point  1  with  a 
Perturbation  of  the  Temperature 
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Figure  6.   Approach  to  the  Steady-State  Point  2  with  a 
Perturbation  of  the  Temperature 
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k .   CONCLUSIONS 
The  constructed  control  system  as  described  in  the  Appendix  behaved 
as  expected  and  performed  as  well  as  other  types  of  thermostats  (such  as 
a  bimetallic  strip  thermostat).  This  system  also  has  the  advantage  that 
it  is  wholly  electronic  and  that  it  uses  simple,  commonly-used  integrated 
circuits  (a  comparator  and  a  shift  register).  The  unique  quality  of  this 
control  system  is  that  the  control  signal  is  a  stochastic  sequence. 
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